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CALIBRATION SYSTEM FOR DOCUMENT PROCESSING 
SYSTEM INCLUDING VISUAL LAYOUT VALIDATION FOR 
TARGET MEASUREMENTS 

5 Field of the Invention 

The subject invention pertains to the field of imaging systems, and in 
particular a system for calibrating an imaging system with reference to a 
predetermined target wherein system output based upon the target can be utilized for 
computing a calibrating function. When measurement of the output for purposes of 
10 computing the caUbrating function indicates a mismatch between a system output and 
a predetermined target, instead of re-measuring the output, the output is reordered in 
accordance with operator guidance, or automatically by minimizing a comparison 
error, so that the measured output can be effectively used for the calibrating function 

p computation. 

fl 15 

Background of the Invention 

Iq Image or document information, as is commonly communicated 

J; through a network or intemet system, is ultimately appreciated by system users 

^ through electronic display or physical printing of the document onto a piece of paper 

20 by a marking engine like a printer. The spacing of such devices over large networks 
^2 presents a need for accuracy and consistency in the device operation. Accordingly, 

O the calibrating of such devices, especially for color imaging, is a regular occurrence. 

The subject invention is particularly directed to facilitating the calibrating processes 
for such devices, particularly printers. 
25 Document Processing Systems ("DPS") refers to a set of devices that 

construct, produce, print, translate, store and archive docimients and their constituent 
elements. Such devices include printers, scanners, fax machines, electronic libraries, 
and the like. The present invention addresses situations particularly relevant to 
printing systems and discusses them as the prime example of a DPS, but the present 
30 invention should not be construed to be limited to any such particular printing 

application. Any DPS is intended to benefit from the advantages of this invention. 

A printer is typically calibrated by providing a preselected set of target 
input signals, e.g., a selected set of CMYK signal values, to be processed by the 
printer and generating outputs corresponding to the inputs. Measurement of the 
35 output colors is performed for determining the calibrating function of the DPS so that 
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the input signals are appropriately adjusted for the DPS to output the precisely desired 
output colors. In other words, the characterization operation of a printer must be 
determined so that the appropriate mapping function is defined for converting the 
desired output color to an appropriate input signal. Such calibrating operations and 
function determinations are well known in the art, and need not be discussed in detail 
herein, except to note that the programmed software that executes the computation of 
the appropriate calibration function, requires accurate correspondence between the 
test target input signals, and the measured device output signals. 



detected only as a generic inconsistency in measurements and not specifically as an 
ordering error. For correction, the user is asked to make fresh measurements which is 
a time consuming and rather boring task. In a closely coupled environment, the 
possibility of mis-orientation on the measurement stage can be somewhat reduced by 
providing suitable control files and specific instructions for the users' measurement 
stage. In a more distributed environment (for example in providing color 
characterization services over the web), however, this level of support/documentation 
for a wide variety of color measurement instruments is rather difficult. 



in the calibration process, is that when a test output is generated for a color 
characterization/calibration process, the input signals are known, as well as how those 
input signals were converted and printed out on a piece of paper, precisely because 
the system controls the printout based upon the input signals. However, the 
measurement process is not known. The system caimot control how a user actually 
measures the system output, i.e., the orientation of the output document and which 
measurement algorithm was employed for the measurement process. 



of a plurality of output elements 20 each corresponding to a different test target 
element of the input target, wherein eight possible different measurement orders are 
shown. The measurement process is usually automated by placing the output 
document onto a measurement platen 30 so that a measurement head 34 moves 
mechanically across the page to hit and measure the color of each output patch 
element. It is clear from the different measurement orders of Fig. 1, that the same set 
of output patches can be measured in many different orders, depending on the control 
exercised in the measurement stage. However, computation of the calibrating 



Prior art systems have several disadvantages. An incorrect ordering is 



The problem addressed by this invention and commonly encountered 



Figures 1(a) - 1(h) illustrate an exemplary output document, comprised 
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function requires an accurate correspondence between the particular order of printing 
and measuring. A mismatched correspondence precludes the calibrating software 
from computing whatsoever the calibrating ftinction. 



calibrating function caimot be computed, prior art systems handled the problem by 
introducing integrity checks which detected the incorrect measvirement order, and 
then required the operator to re-measure the output document, which, as noted above, 
would require additional work and time from the operator. The incorrect order of 
measurements typically resulted from the operator somehow "flipping" the output 
document to a mis-oriented position, or also when the application of the control 
algorithm utilized an incorrect order of measurement of the output patch elements. 



even after an incorrect measurement order is performed, by taking advantage of the • 
fact that all the appropriate data for computing the calibrating function is available. 
The incorrect order of measurement can be re-ordered into a correct order of 
measurement. The possible discrepancies between the orders of measurements can be 
expected by the characterization software, and the actual measurement order 
determined by different possible orientations of the target on the measurement stage 
and different possible control files defining the measurement order so that the 
determined order of measurements is correct. By considering the possible mis- 
orientations of the target and determining, either automatically, or visually, which one 
corresponds to the target, the invention allows the data to be reordered instead of 
requiring time-consuming and arduous re-measurements. Additionally, the chances 
of mis-orientation are reduced by providing methods for guiding the user in orienting 
the target at measurement time. 



document processing system (DPS) comprising the steps of providing a target 
comprised of a plurality of target elements to the DPS. An output is generated from 
the DPS from the target. The output includes a plurality of output elements 
corresponding to the target elements. The DPS output is measured relative to the 
target for computing a calibrating function for the DPS. When the measuring 
indicates a mismatch between the target elements and the output elements, the output 



When an "incorrect" order of measurement is performed so that the 



The subject invention particularly obviates the re-measurement process 



Summary of the Invention 

One aspect of the present invention is a method for calibrating a 
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elements are reordered for matching the measured output elements to the target 
elements whereby the computing of the calibrating function can be done without 
having to re-measure the output elements. 



calibrating function includes an expectation of a predetermined value for the 
measuring of the target. The mismatch is indicated when the computing of the 
calibrating function exceeds a threshold error from the predetermined value. Such 
mismatch can occur relative to a sequential order of measuring target elements 
defined by the measuring step, or relative to position "flipping" of the DPS output 
from the provided target. 



minimum error value in the computing of the calibrating function, and interpreting the 
minimum error value as indicative of a correct reordering of the measured output 
element data. The minimum error of value can be computed from a set of likely 
orderings of the output elements relative to the target elements. 



performed semi-automatically or automatically. Correcting in a semi-automatic 
manner involves a visual validation by an operator of the output document orientation 
for the measurement stage or the measurement order for the output patch elements. 
Visual validation could comprise a presentation by the system of the likely 
possibilities of the orientation and order of measurements and selection by the 
operator. Automatic correction comprises determining an error value in the 
computing of the calibrating function. When the error exceeds some predetermined 
threshold, the system identifies a mismatch between the input target and the measured 
output. Possible reorderings of the measurement process are effected until a 
minimum error value is determined, which minimum error value is associated with 
the correct reordering. The calibrating function is then computed from the corrected 
reordering. The predetermined value associated with the target can be computed from 
a prior calibration of the printer or computed from a model for the printer. 



which expedites the computing of the calibrating function by validating that the 
measurement stage is only accomplished with a correct ordering of the output relative 
to the input target. The method comprises providing the target to the DPS and 
associating the target with a corresponding measuring process. The output is 



Another aspect of the present invention is that the computing of the 



Another aspect of the present invention comprises determining a 



Another aspect of the present invention is that the reordering can be 



An alternative aspect of the present invention is a calibration system 
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generated by the DPS. The output is disposed to be measured in a selected position in 
a measuring device for the computing of the calibrating function. Prior to the 
measuring, a user of a DPS is provided with a visual representation of the 
corresponding measuring process including a desired position of the output for the 
measuring. The user validates the selected position of the output relative to the 
provided representation so that the output can be properly measured and the 
calibration function can be computed. The representation of the corresponding 
measuring process includes imaging for the user of a selected position of the disposed 
output that provides a measurement in the correct order with respect to the DPS 
calibration process. If several control files are stored on the measuring system, visual 
thumbnail representations corresponding to each of these control files are displayed 
and the user selects the thumbnail that matches the target to be measured and orients 
the target in the displayed orientation. The visual representation of the target 
provided to the user and the control commands for the measurement stage are 
generated concurrently with the target layout and preferably packaged together, 
possibly as a single control file within the operating software that can be used at the 
measurement stage. 

The principal advantage of the subject invention is the avoidance of 
having to re-measure a DPS output for the computation of the calibrating function 
when an operator has incorrectly disposed the output for the measurement stage 
relative to what target input the DPS used to generate the output. 

Another advantage of the subject invention is a system which 
facilitates the correct orientation and ordering of the measurement stage by 
preliminarily advising the operator, preferably by a visual indicator, of what the 
system expects the position and measurement order to be in order to properly execute 
the measurement stage. 

Yet another advantage of the present invention is the correction of a 
mismatch in the computation of the calibrating function due to a flipping or shift in 
the measurement order of the control patches, either semi-automatically or 
automatically. 

Further objects and advantages of the present invention will become 
apparent from the following descriptions of the various embodiments and 
characteristic features of the present invention. 
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Brief Description of the Drawings 

The following is a brief description of each drawing used to describe 
the present invention, and are being illustrated for illustration purposes only and 
should not be limitative of the scope of the present invention, wherein: 

FIGURES 1 (a) - 1 (h) illustrate alternative orientations and orders of 
measurement for a plurality of test patch outputs; 

FIGURE 2 is a schematic illustrating how a representation of a target 
can be used in a graphic/image to guide the placement of a target on a measurement 
stage; 

FIGURE 3 is a flowchart illustrating the steps practiced for either an 
automatic or semi-automatic correction of the calibration process practiced in 
accordance with the present invention; 

FIGURE 4 is a flowchart illustrating the steps of an alternative 
embodiment of the invention for validating an orientation and a measuring order prior 
to measurement execution for computing a calibrating function; and, 

FIGURE 5 is a flow chart illustrating another alternative embodiment 
of the invention for validating an orientation and a measuring order prior to 
measurement execution for computing a calibrating function. 

Detailed Description of the Present Invention 

The following is a detailed description of the invention and the 
supporting drawings for purposes of illustrating the preferred embodiments of the 
invention. Although alternatives are discussed, the detailed description is exemplary 
and not meant to be limiting to the scope of the invention or its equivalents. 

Color characterization of a DPS is commonly performed as a two step 
process. In the first step, characterization software generates a target (e.g.. Fig. 2) 
with a set of color patches specified in terms of DPS control values (e.g., CMYK 
signals) which can be printed or imaged on the DPS to be characterized. The printed 
target is then measured by a measurement stage. In the second step, the measured 
values are provided to the characterization software and the software uses the 
correspondence between the target control values and the DPS measured values to 
derive the DPS characterization profile. Such a profile can be a mapping or control 
function and for purposes of simplification, will hereinafter be referred to as the 
calibration function. 
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Since the target generated for printing is typically a two dimensional 



layout on one or more pages, the measurements for the target could be made with a 
number of different orientations of the target page(s) on a measurement stage and in a 
number of different orders for accessing the patches; for example, left to right across 
rows, moving among the rows from top to bottom; or top to bottom across the 
columns moving across columns from right to left, such as shovm in Fig. 1(a) - .1(h). 
However, in order for the characterization process to work, it is necessary that the 
characterization software knows which measurement corresponds to which set of 
device control values used in generating the target. In the past, this has been tackled 
by having a fixed measurement order that the characterization software requires — for 
instance, left to right across the rows and moving among rows from top to bottom 
when the target is held with (for instance) text in the target oriented upright (as in Fig. 
2). If such a system, which assumes a fixed measurement order for the target patches, 
is fed measurements of the target made in an incorrect order, it would either result in a 
totally useless characterization, or if the software includes "integrity checks", the 
incorrect ordering is detected as a large deviation from expected printer behavior and 
the user is then required to make fresh measurements using the correct measurement 
order. 

Automatic and semi-automatic detection and correction 
of ordering errors produced by ''mis-orientation" 



fact that one can recover from common "mis-orientations" of the target on the 
measurement stage through a process of reordering the measurements. The reordering 
may be guided either by a visual confirmation from a user or through an automatic 
correlation of the color measurements and the device control values. 



target is a single page comprised of several hundred test patches. For simplicity in 
explanation, only a few exemplary patches are shown in Figs. 1 and 2. The method 
can however be readily generalized to multiple target pages by applying the same 
technique to each printed page and over pages (possibly by partitioning raw 
measurements into pages using the known number of patches per page from the target 
generation step and the reasonable assumption that measurements corresponding to a 



With reference to the flowchart of Fig. 3, the invention relies on the 



In the following description it will be assumed that the calibration 
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page are contiguous). Sample color characterization targets are shown in Figs. 1(a) - 
(h) and can be measured by any of the orders shown therein. 

The target is generated 40 by the calibration software so that the output 
patches when printed 42 are oriented along a rectangular grid (this is usually the case, 
though not a requirement) over the page. Typical automated color/spectral 
measurement stages 30 access 44 a measurement control file from the software and 
provide methods for readily measuring such targets by placing the target on the stage 
and then specifying, by means of the control file, a measurement sequence for the 
patches 32 as they appear on the stage (for example, left to right across rows, moving 
among the rows from top to bottom; or top to bottom across the columns moving 
across colunms from right to left). The target orientation on the measurement stage 
could potentially be varied in several different ways by flipping/rotating the target and 
the measurement stage control file could vary the order in which the patches are 
measured. Due to these various degrees of freedom in the target placement and in the 
control files, there are several possible correspondences between the sequence of 
target color/spectral measurements and the physical placement of the target patches 
on the page. In existing systems, usually, only one of these correspondences is 
allowed as a correct one and others result in incorrect characterization or request a re- 
measurement by the user. In order to remedy this problem, the subject invention 
automatically determines the different potential correspondences and determines the 
one that is correct. For a rectangular target layout like the one shown in Fig. 1, it is 
highly likely that the target region of the page will be measured in one of the 
following eight orders (specified, for instance, when the target is oriented with the 
text upright. Fig. 2: (1) left-to-right across rows, moving among the rows from top to 
bottom; (2) left-to-right across rows, moving among the rows from bottom to top; (3) 
right-to-left across rows, moving among the rows from tope to bottom; (4) right-to- 
left across rows, moving among the rows from bottom to top; (5) top to bottom across 
the columns moving across columns from right to left; (6) bottom to top across the 
columns moving across columns from right to left; (7)top to bottom across the 
columns moving across columns from left to right; and (8) bottom to top across the 
columns moving across columns right to left. These measurement orders are shown 
graphically in Fig. 1 . Note that additional orders, such as for example a serpentine 
scan, could be considered similarly. 
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If the measurement data is acquired from correctly corresponding data 
45, then the calibration function can be computed 46 and the process is done 48. If 
not, the present invention provides for corrections without remeasurement. 

In one embodiment of the invention (semi-automatic correction 50), 
the characterization/profiHng software regenerates eight different rectangular-grids of 
patches having the same number of rows and columns as the cahbration target (this is 
known since the target itself was generated by the characterization software). The 
colors of the patches in each of the grids are set by arranging the color/spectral 
measurements for the target patches in each of the above-mentioned eight 
measurement orders. The user is then presented 52 with these different rectangular- 
grids on a display and asked to pick the one whose orientation matches the orientation 
of the physical printed DPS output when it is held with the text upright (alternate 
methods may be used for specifying the orientation of the physical target if no text is 
present - for example, with the cyan wedge on top and with the most saturated cyan 
patch to the left). Once the user enters 54 the number of the rectangular-grid layout 
that matches the printed target, the correspondence between the physical target 
patches and the measurement data is unambiguously established. Since the physical 
target layout is generated by the characterization software, it can use this 
correspondence to obtain the correspondence between device control values and the 
measurement values for each of the target patches and the characterization can then be 
performed 56 using the measured data. For testing a large number of potential 
measurement orders (for instance with serpentine scans of the patches), multiple 
display screens of orientations may be used until the user indicates a match 
(organizing the most common "mis-orientations" in the earlier screens would make 
this more efficient). In addition, as a first step, instead of generating all rectangular- 
grids, a single rectangular-grid layout corresponding to a default assumed order that 
matches the physical target could be presented to the user asking him/her to visually 
check the layout with the physical target. The second step of generating and 
displaying all other rectangular grids may then be performed only if the user indicates 
that this order is incorrect. The system could also be set up so that visual verification 
is invoked only if the automatic integrity check indicates an error in target layout. 
(This allows the printer characterization to proceed with minimal user intervention 
unless a problem is encountered.) 



C:\Data\PRR\00NOV\X2390APP.DOC 



9 




jDocketNo. XER2 0390 
' D/A0648 



In another embodiment of the invention (automatic correction 58), the 
process could be further automated by using some knowledge of the printer 
characteristics. For instance, if a profile model for the printer (or a similar class of 
printer) is available (e.g., from a previous calibration) the device control values used 
5 in generating the target can be used to determine expected color values for the target 
patches. These values can then be reordered to correspond to the measured values 
using each of the possible assumed measurement orders for the target patches. Color 
differences (e.g. an error value, AE) between corresponding color values in these 
predictions and the actual measurements can then be computed 60 for each of the 
1 0 assumed measurement orders and these can be used to determine the most likely 
measurement order. For instance, the most likely measurement order may be 
determined as the case which yields 62 the smallest average (or some other statistic) 
^ color difference. Instead of arranging the predictions in different orders, equivalently, 

""^J the measured target values could be arranged in different orders yielding the same (or 

I n 1 5 almost the same, for asymmetric color differences) results. Note that the automated 
system can readily search through a much larger number of "mis-orientations" than 
Hi one could reasonably present to a user for a visual check. The so determined correct 

order is then used 64 to compute the calibration function. Note that the invention is 
^ applicable even if there is no prior knowledge of the printer characteristics, but the 

£1 20 calibration function is suitably constrained to model only reasonable devices. For 
^ instance, the calibration function may rely on a parametric device model or may have 

a functional form that precludes it for accurately representing jumbled data. In this 
case, the correct measurement order may simply be determined by a brute force 
approach that determines the calibration function for several possible measurement 
25 orders and selects the ordering based on the accuracy of the determined calibration 
function in representing the measured target patches. 

In a third embodiment, the methods of the first and second 
embodiment could be combined with the average color difference being used to 
winnow down the number of orderings to a reasonably small set, and to determine the 
30 sequence of possible orderings to display (i.e., display the most probable ordering 

first, etc.) Finally, one of the layouts is selected by the user after a visual comparison 
to the physical target. 

It is worth noting again, that the methods described here are 
particularly useful in a web-based (or other distributed) color profiling systems where 



C:\Data\PRRV00NOV\X2390APP.DOC 



jDocketNo. XER 2 0390 
D/A0648 



there is little control over the user's measurement environment (w^hich may also be 
hard to support given the diversity of measurement instruments). The color 
characteristics of monitors are fairly standardized and relatively easy calibration 
methods are available for monitors so the presentation of a target layout of the type of 
Fig. 3 can be done on the screen with fairly good color accuracy. 

With reference to Fig. 4, an alternative embodiment is illustrated v^hich 
prevents a mismatch at the measurement stage. 



Use of softproofing to assist in correct target orientation 
at the measurement stage 

Target generation 70, DPS patch output 72 and disposition 74 of the 
output patches on the measurement stage are the same as in the above methods. 
When the user measures a target on an automated measurement stage such as the 
Gretag® Spectrolino® Spectroscan he first has to select a control chart that 
corresponds to the target being measured. The chart menu typically contains a long 
list of control charts created for different custom targets. A novice user may have 
difficulty selecting the correct chart from this list. In addition, once the user has 
selected a chart, the target page itself may be oriented in multiple different 
orientations on the measurement stage. To aid the user in both these steps of control 
chart selection and target orientation on the stage, this embodiment of the of the 
invention proposes softproofing to display the target layout corresponding to one or 
more control chart thumbnail representations. The user can then select the chart 
whose thumbnail matches the print he is about to measure. The thumbnail can also 
provide the orientation for the target on the measurement stage. This will reduce the 
burden on the user and decrease occurrences of incorrect layouts and measurements. 

Note that three things need to be known in one place in order to be able 
to produce the correct thumbnails/images indicating target orientation on the stage: 
(1) the target layout and the order in which the device control values are placed in that 
layout, (2) the expected colors corresponding to the device control values used in 
generating the target; and (3) the device control chart options that specify the order of 
measurements on the stage. The idea could be implemented in a number of different 
ways. The characterization software could convey (1) and (2) to the measurement 
workstation (which then uses it with (3) which it has). Altemately, the measurement 
stage could convey (3) to the characterization software before the target generation 
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Step and it could use that with (1) and (2), which it generates (standard network 
protocols such as ftp may be used to send this information). Or alternately yet, the 
characterization software could itself generate (1), (2) and (3), which is the 
embodiment that is illustrated in Figure 4. 

At the time of generation 70 of the target, the cheiracterization software 
has knowledge of the target layout, the device control values for the target patches, 
and their placement in the layout. Corresponding expected color values can be 
obtained by using an existing characterization profile/model of the printer, or a similar 
printer. If the characterization software also has some knowledge of the measurement 
instrument, it can generate a control chart for the device that controls the 
measurement order for the instrument. If the chart format supports it, the RGB values 
corresponding to the expected colors in the target can be embedded in the control 
chart so that when the measurement workstation displays these RGB values it 
corresponds to the correct orientation of the target on the measurement stage. There 
are two sections; one that specifies layout, and other optional section that contains 
colors (in R, G, B) to be "poured" into the given layout for display on the screen when 
the user is instructed to align the measurement stage with the target. It would be 
beneficial at the time of this alignment to have the display on the screen which shows: 
(a) the target with colors closely matching the color in the user's printed target and 
also (b) the desired orientation of the target on the measurement stage. This could be 
done for instance by displaying 78 a color graphic showing the chart on the 
measurement stage with the correct orientation for the target as shown schematically 
in Fig. 2. 

If the chart format does not support this feature, the functionality can 
still be provided by generating an alternate image/thumbnail that shows the physical 
placement of the target on the measurement stage and providing both this image and 
the control chart file to the measurement workstation. 

The operator can select the proper thumbnail for effective validation 80 
of output orientation and measurement order and calibration is completed 

An alternate embodiment of the invention is shown in Fig. 5, in which 
along with the target generated for printing, a set of predicted values for the 
corresponding patches (in the sequence for "correct" measurement) are generated 90. 
Concurrently with DPS output generation 92, the predicted values are conveyed to the 
measurement station, where they are used 94 with the control files available at the 
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measurement station to generate 96 visual representations of the target as it would 
have to be placed 98 on the measurement stage to produce the predicted values in the 
correct sequence. Note using the number of measurements, a number of invaUd 
control files may be eliminated, and the operator may have to eliminate additional 
ones by checking 100 that the target cannot be physically oriented in the orientation 
shown in the visual representation. If in addition to the predicted values for the target 
patches, layout information is also included and provided to the measurement station, 
the layout information can be used with the available control files to automatically 
determine one or more that will work. The corresponding visual representation may 
then be provided to the operator of the measurement station to assist in correctly 
orienting the target for computing 102 the calibration function. 

The invention has been described with reference to preferred 
embodiments, obviously alterations and modifications will occur to those of ordinary 
skill in the art. It is our intention to include all such equivalents within the scope of 
the invention. 
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